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Abstract. Conditions arc provided under which an endomorphism on quasisymmetric 
functions gives rise to a left random walk on the descent algebra which is also a lumping of 
a left random walk on permutations. Spectral results are also obtained. Several well-studied 
random walks are now realized this way: Stanley's QS-distribution results from endomor- 
phisms given by evaluation maps, a-shuffles result from the a-th convolution power of the 
universal character, and the Tchebyshev operator of the second kind introduced recently by 
Ehrenborg and Readdy yields traditional riffle shuffles. A conjecture of Ehrenborg regarding 
the spectra for a family of random walks on a6-words is proven. A theorem of Stembridge 
from the theory of enriched P-partitions is also recovered as a special case. 



1. Introduction 

Quasisymmetric functions have long been used for encoding and manipulating enumera- 
tive combinatorial data. They admit a natural graded Hopf algebra structure Q = 
central to the study of combinatorial Hopf algebras [2] . Their dual relationship to noncom- 
mutative symmetric functions [19], as well as to Solomon's descent algebras [3X1 [20l [27] , are 
an important part of the story and have inspired a broad literature. 

A major goal of this paper is to identify and develop bridges between some of this lit- 
erature and the body of work surrounding Bidigare, Hanlon, and Rockmore's far-reaching 
generalizations of Markov chains for various common shuffling and sorting schemes, the 
main references being [H [5l [TOl [TTl [12] . Stanley first recognized and established a connec- 
tion between quasisymmetric functions and this work in [M]. We deepen this connection 
and draw combinatorial Hopf algebras into the story by proving that endomorphisms on 
quasisymmetric functions which satisfy certain nonnegativity requirements always give rise 
to random walks both on permutations and also on the descent algebra. Stanley's QS- 
distribution may be regarded as the special case where the endomorphism corresponds to 
an evaluation map. Some consequences of this relationship are as follows: (1) whenever a 
random walk on permutations or the descent algebra arises this way, its transition matrix 
will be lower triangular with respect to the monomial basis of quasisymmetric functions; (2) 
these transition matrices often turn out to be diagonalizable with respect to bases that are 
quite natural from the viewpoint of quasisymmetric functions; (3) in some cases, one may 
directly transfer known spectral results from one setting to the other. 

Our original motivation was to understand the probabilistic behavior of an important 
endomorphism O : Q — Q introduced by Stembridge [35] in his development of enriched 
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P-partitions. Billera, Hsiao, and van Willigenburg observed [8] that 6 can be represented 
by a stochastic matrix (after normahzation) with unique stationary distribution equal to 
the distribution of peak sets of random permutations. The associated random walk on peak 
sets was conjectured to specialize a family of random walks on permutations having uniform 
stationary distribution, a conjecture which turns out to be correct. 

It was soon pointed out [2], [6] that the B-map is dual to a specialization at g = — 1 of the 
A I— > (1 — q)A transformation on noncommutative symmetric functions introduced by Krob, 
Leclerc, and Thibon [24]. They develop a series of general results about these transformations 
that include a complete description of their spectral decompositions. They also describe these 
transformations as acting by multiplication on Solomon's descent algebra, and based on their 
description it is easy to resolve the conjecture made in [S]. The dual relationship between 
and a multiplicative operator on the descent algebra turns out to be one instance of a much 
more general phenomenon, which we develop in Section [31 

Section [21 briefly gives background on quasisymmetric functions, the descent algebra, non- 
commutative symmetric functions and lumping of random walks. Section [3l draws together 
results about characters on combinatorial Hopf algebras and makes some new observations 
so as to characterize which endomorphisms on quasisymmetric functions give rise to Markov 
chains. In addition, a characterization of when the stationary distribution is unique (in 
which case it is uniform) is given. In Section [H it is then shown how in this setting one may 
read off the eigenvalues, and in fact an eigenbasis is constructed by a recursive procedure. 
Section \5\ describes the resulting transition matrices quite explicitly. 

Turning now to applications. Section [61 expresses Stanley's QS'-distribution as the spe- 
cial case of random walks driven by the endomorphism on Q resulting from evaluating the 
quasisymmetric functions at a specified point (ri,r2,...) where each is a real number. 
Section [71 deals with the well-studied a-shuffles where a deck of cards is split into a (possibly 
empty) piles which are then shuffled; this random walk results from a very natural endo- 
morphism on Q, namely the a-th convolution power of the universal character. Connecting 
all this to the literature on enumeration in posets, we show that Ehrenborg and Readdy's 
Tchebyshev operator of the second kind on Q encodes standard riffle shuffles [TS], and in 
Section [HI we prove a conjecture of Ehrenborg regarding the spectra for a certain family of 
random walks on a6- words that arise from the r-Birkoff transform [IT]. In fact, we explicitly 
describe the transition probabilities of these walks in a way that generalizes a theorem of 
Stembridge from [35] . 

For an overview of the literature on shuffling and related topics, the survey by Diaconis 
[13] is a very helpful resource. We also recommend [36] and [2[ [3] for further background on 
Hopf algebras and on combinatorial Hopf algebras, respectively. 



2. Background 

This section reviews background on quasisymmetric functions, noncommutative symmetric 
functions, and the descent algebra, including bases and products to be used in later sections, 
as well as a key property of the resulting Markov chains called lumping. We work over the 
rational numbers Q, although most of our results hold over any field of characteristic 0. 



RANDOM WALKS ON QUASISYMMETRIC FUNCTIONS 



3 



2.1. Quasisymmetric functions. Let Xi, X2, ■ ■ ■ be an ordered list of variables. Let n > 
and a = (ai,...,afc) be a composition of n, that is, a sequence of positive integers that 
sums to I a I = n. The abbreviated notation a = ai . . . ak will often be used. The monomial 
quasisymmetric function indexed by a is the formal power series 

h<---<ik 

Any linear combination (over Q) of monomial quasisymmetric functions is called a quasisym- 
metric function. In order for a formal power series to be a quasisymmetric function, notice 
that for any composition a and any two monomials x'^^x'}^ ■ ■ -x"* and x'^^x'^^ ■ ■ ■ x°j^ with 
ii < ■ ■ ■ < ik and ji < ■ ■ ■ < jk, these monomials must have the same coefficient in the 
quasisymmetric function; thus, quasisymmetric functions are indexed by the compositions 
of integers in exactly the way that symmetric functions are indexed by number partitions. 
They were introduced by Gessel as generating functions for weights of P-partitions [20] . 

Let Comp(n) denote the set of compositions of n and Qn denote the linear span of 
{Ma}a£Comp{n)- The vector space Q = 0„>o Qn of quasisymmetric functions has the struc- 
ture of a graded Hopf algebra: The product is ordinary multiplication of power series and 
the coproduct is defined on a monomial function by 

Aq(M„) = Mfs^M^, 

a=/3-7 

the sum being over all ways of writing a as the concatenation of two (possibly empty) 
compositions (3 and 7. The set of (Hopf algebra) endomorphism on Q is denoted End(Q). 

Define a partial order on Comp(n) by setting a < /3 if is a refinement of a; that is, 
P is the concatenation of compositions P = Pi - ■ ■ Pk such that a = {\Pi\, . . . ,\Pk\). Given 
a = (ai, . . . , ak) G Comp(n) let us define Sa C [n — 1] by Sa = {oi, ai + 02, . . . , ai + ■ ■ ■ + 0^}. 
The correspondence a 1— > 5*0, is an isomorphism of posets between Comp(?7,) and the set of 
subsets of [n — 1] under inclusion. The composition corresponding to 5* C [ri — 1] is denoted 
co(S'). Thus, co(S'q,) = a. 

For a G Comp(n), define the fundamental quasisymmetric function Fa by 

(2.1) Fa= ^n■■■^^,.= 

i^<i2<---<in /3eComp(n): /3>o 

By inclusion-exclusion, 

/3eComp(n): /3>a 

where £{a) denotes the number of parts, or length, of a. Thus {Fa} is a basis for Q. 
See [33l [27] for further background on quasisymmetric functions. 

2.2. Descent algebra. For n > 0, let (5„ denote the set of permutations of [n]. A permu- 
tation a G &n will be represented as a sequence a = (o"i, . . . ,<Jn), where o"j = (t(z). The 
descent set of a is defined by Des((7) = {i E [n — 1] : ai > ai^i}. The descent composition 
of cr is defined by D{a) = co(Des{a)) . The set of permutations that have the same descent 
composition is called a descent class. 
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For a G Comp(?7,), define G P„ and G Vn by 

(2.2) F„= a 

a-e&n.D{a)=a 

(2.3) X^= Yl E 

/3GComp(n):/3<o crGS„:D(cr)<a 

A well-known result due to Solomon [31] asserts that the vector space spanned by {Xa}a&Comp{n) 
(or equivalently {Ya\ a&Comp{n)) is a subalgebra of the group algebra QfSn]- This subalgebra 
is called the descent algebra and we denote it by P^. 

Let V = 0,^0 -^fi ^ ~ rii^o-^*- element W & V can be represented uniquely as 
a formal series W = ^„>o W^n, where Wn G Vn- From this viewpoint V is the subspace of 

V consisting of those formal series having only finitely many nonzero terms. We will think 
of V as an algebra with component-wise multiplication: (^ Wn) ■ {Y2 Ki) = X] ■ Vn- Note 
that the series X = X]n>o ^™ identity element of V. 

Let (■ I ■) : V X Q— >Qbe the bilinear form defined for any pair of compositions a, /3 by 

{Xa I Mp) = 6a,i3, or equivalently {Ya \ Fp) = 6a,p. 

We hereby use the pairing (■ | ■) to identify V with the dual vector space of Q, and Vn with 
the dual of Q„. 

2.3. Noncommutative symmetric functions. Define a new product -k and coproduct 
on V by 

(2.4) X^^Xp = X^.^ 

Ap(X„) = J2 Xi®Xj, 

i+j=n 

The definition of Ati extends to every Xa by requiring Ajj{U-kV) = Ax)(?7)*Ax)(l^). There is 
a natural isomorphism between {V, ic, Axi) and the graded Hopf algebra of noncommutative 
symmetric functions [11], in which X^ is mapped to the complete symmetric function S*". 
The following result is part of Theorem 6.1 in [TH] (cf. [27]). 

Theorem 2.1. (P,*, A75) is the graded dual Hopf algebra of Q under the pairing (■ | ■). 

Under the isomorphism between {V, Ax^) and the Hopf algebra of noncommutative sym- 
metric functions, the usual product on V inherited from the group algebra is opposite to 
the internal product on noncommutative symmetric functions [T^ Section 5]. The next re- 
sult, which appears as Proposition 5.2 in [19], explicitly relates multiplication in the descent 
algebra to the product -k and coproduct A© (and thereby also Q, by duality). 

Proposition 2.2. Forr > 2 let A^ be defined inductively by A|, = A^ and A^ = A^~"^ ®/, 
where I is the identity operator on V. For any G, Fi, . . . , Fr & V, we have 

G-{F,^---*Fr) = 5^(G(i) ■ Fi) ^ ■ ■ ■ * (G(,) ■ Fr). 

G 

where A^(G') = J2g ® ' ' ' ® G{r) in Sweedler notation. 
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2.4. Lumping of random walks. Suppose that K is the transition probabihty matrix for 
a Markov chain with state space Suppose also that K has the property that 

(2.5) Yl K{7r,a)= Yl ^) 

o-G6„:D(cr)=a (7e6„:D(o-)=a 

for any a G Comp(n) and 7r,r G such that -D(vr) = D{t). In this case we may define a 
new Markov chain with state space Comp(r2) and transition probability matrix K given by 

(2.6) K{D{n),f3)= ^ i^(7r,a). 

(TG6„;D(a)=/3 

In other words, K{a,f3) is the probability that a permutation with descent composition a 
moves to some permutation with descent composition /3 in one step of the original Markov 
chain. We shall say that K lumps K by descent sets. Lumping is discussed in §6.3 in Kemeny 
and Snell's book [23] . 

Lumping by descent sets occurs when a random walk on ©„, is driven by a probability 
distribution that is constant on descent classes, as we now explain. Let W = X^^-gg^ W{a)a 
be a probability distribution on (5„ such that W G Vn- Consider the Markov chain with 
state space (5„ and transition probability matrix given by K{7r,a7T) = W{a~^). Then the 
expression on the left-hand side of (12.51) represents the coefficient oi tt in W ■ while the 
right-hand side represents the coefficient of r. If D^ii) = D{t) then these coefficients are 
equal by the fact that P„ is a subalgebra of Q[(5„]. This means K can be lumped by 
descent sets, and the column of K indexed by (n) encodes the mth convolution power of 
the distribution W: 

(2.7) Z"'(D(7r),n) = iy*'"(7r). 

Now we show how the eigenvalues and eigenvectors of the two matrices are related to each 
other. 

Proposition 2.3. Each eigenvector of K gives rise to an eigenvector for K with the same 
eigenvalue. Moreover, linearly independent eigenvectors are thereby sent to eigenvectors that 
remain linearly independent. 

Proof. If the coordinate indexed by a particular descent class has value Oj in a chosen eigen- 
vector of i^, then assigning value ai/d for each permutation in the descent class, letting d 
be the size of the descent class, yields an eigenvector of K. The fact that this is indeed an 
eigenvector of K follows again from the fact that K admits a lumping according to descent 
classes. □ 

Proposition 2.4. The matrix K is block diagonalizable, with one (n! — 2""-*^) by (n! — 2""^) 
block and each descent class Di giving rise to a 1 by 1 block. 

Proof. The idea is to show how to decompose the vector space upon which acts into 
subspaces each of which is carried to itself by . For each descent class Di, notice that 
has an eigenvector by setting each coordinate indexed by an element of the descent class to 
1 and all other coordinates to 0. On the other hand, we obtain an {n\ — 2"~^)-dimensional 
subspace also sent to itself by by considering those vectors where the coordinates indexed 
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by permutations in any chosen descent class Di sum to and all other coordinates are 0. It 
follows easily from the definition of lumping that each of these vectors is sent to a vector with 
the property that for any descent class, its coordinates which are indexed by permutations 
in that descent class sum to 0. □ 

Question: When our random walk arises from a left action of the descent algebra, does this 
imply further structure on K7 

3. Random walks resulting from endomorphisms of Q 

This section ties together results from [2], [19], and [29] to deduce a new consequence, 
namely that endomorphisms of quasisymmetric functions give rise to random walks under 
mild nonnegativity conditions. 

Let $ G End(Q) and n > 0. Define Cq,^/3, for G Comp(n) by 

(3.1) <f(F,)= 

/3eComp(n) 

Thus, c„,^ = {Yp I . 

Suppose that the numbers Ca,n, a G Comp(n), are nonnegative and identically zero. Define 
a probabihty measure Prob$ : ©„ ^ R by 

(3.2) Prob$(7r) = Jf^"^'" . 

We will call this the QS*- distribution corresponding to $ because of its connection to Stan- 
ley's QS'-distribution [M], as explained in Section O 

Consider the random walk on where vr goes to an with probability Prob<i>((7~^). Denote 
the corresponding transition probability matrix by K, so that 

K{71,0"It) = Prob$(cr~^). 

Note that the transpose of K is the transition matrix of the left random walk on ©„ driven 
by J2ae& Pi'ob$((T)cr, where one step takes tt to an with probability Prob((j). 

Let A G Q be defined by $(Mi) = AMi. Let $„, denote the restriction map If 
A 7^ 0, then define K to be the transpose of the matrix representing relative to the 

fundamental basis, namely 

for all a,(5 E Comp(?T,). If we need to be explicit about about n and $ then we will write 
K^. The same goes for K. 

Theorem 3.1. Let $ G End(Q) andn > 0, and suppose that the numbers Ca,n, o: G Comp(n), 
are nonnegative and not identically zero. Then A" > and K is a stochastic matrix. Fur- 
thermore, K lumps K by descent sets. 

Let us illustrate Theorem 13.11 with an example with Stembridge's B-map before turning 
to the proof. 
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Example 3.2. Given a G Comp(?7,) for some n > 1, let A(a) = {i ^ Sa \ i ^ \ and 
i- \ ^ So). For instance, if a = 1121134 then 5^ = {1,2,4,5,6,9} and A(a) = {4,9}. 
Thus, if a is the descent composition of a permutation vr G then A(a) is the 'peak set of 
TT, namely the set {i G [2,n — 1] | 7rj_i < TTj > TTj+i}. According to [35l Proposition 3.5], 6 
can be defined in terms of the fundamental basis by 

e(F„) = 2i^(")i+i Yl 

/3gComp{n) 
A(c)CS^A(S^+l) 

where T+l = {t + l|tG T} and A stands for the symmetric difference: A/\B = 
[A — B)U {B — A) . It is well known that is a Hopf algebra homomorphism [21 Example 4.9]. 
The corresponding (5>S'*-distribution is given by 

if the peak set of n is empty 
otherwise. 

This is the probability that a deck of n cards is in arrangement tt after an inverse face-up face- 
down shuffle [1] : Remove a subset of cards from the deck, letting all subsets have the same 
chance of being selected, and place the packet face down on top of the remaining cards. The 
row of K indexed by (n) gives the distribution of descent sets after performing one face-up 
face-down shuffle: Cut the deck into two packets according to the binomial distribution, flip 
the top packet over so the cards are facing up, then shuffle the two packets; the probability 
of ending up with a permutation with descent composition a is K{n, a). For instance. 
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Each entry, say A'(21, 12) = 1/2, can be explained in terms of lumping K by descents 
as follows. Pick any permutation vr G ©3 such that -D(7r) = 21, say vr = 132 (short for 
vTi = 1,712 = 3, vTs = 2). Then i<'(21, 12) should be the probability a permutation cr G ©3 
chosen with probability Probe (a) will have the property that D{a~^7T) = 12. 

Stembridge [35l Theorem 3.6] provides an alternate probabilistic interpretation of 6: Given 
vr G &n, independently assign a -|- or — sign to every VTj, letting each sign occur with 
probability 1/2. Then the probability that the resulting signed permutation has descent 
composition /? is K{D{ti), (3). We generalize Stembridge's result in Section [HI 

The proof of Theorem 13. II amounts to showing that $„ is, after normalization, dual to the 
operator on Vn given hy W ^ (So-e6„ Prob$(cr) a) ■ W. We begin by setting up a bijection 
between End(Q) and those series in V that encode characters of Q. Recall that we have 
identified the dual vector space of Q with P, the set of formal infinite series X]n>o such 
that Wn G T^n- Thus, a character of Q is a series W & T> such that (W^ | 1) = 1 and 
{W I FG) = {W \F){W \ G) for all F,G e Q. 



(3.3) 



Probe (tt) 
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A character of fundamental importance is the series X = J2n>o^n, where X„ is the 
identity permutation in (3„ (see (12 .SI) ). This is called the universal character. It follows 
from the definition of X that 



{X I M,) = (X I F,) 



1 if a = or a = (n) 
otherwise. 



Thus, for any quasisymmetric function F{xi,X2, ■ ■ .), 

(X|F(xi,X2,...))=F(l,0,0,...). 

For $ e End(Q) and W eV, define the series W"^ E V hj 

(1^* \ .) = {W \ $(■)). 

In the theory of combinatorial Hopf algebras, X satisfies a universal property [21 Theo- 
rem 4.1], of which the following is an immediate corollary: 

Proposition 3.3. The correspondence $ X* is a bijection between End(Q) and the set 
of characters of Q . Moreover, 

(3.4) <I>(M„) = ^(X* I M^,>---(X* I M^„>M(|^,,,...,,^„,), 

where the sum is over all sequences of compositions Pi, ... , fim such that /?i ■ ■ ■ (3m = «■ 

Remark 3.4. It follows from Proposition 13.31 that the matrix relative to the monomial basis 
for $ as a linear operator on Q„ is lower triangular, provided that the ordering of the basis 
elements is a linear extension of the partial ordering on Comp(?2). 

Next we develop some properties of characters to be used shortly. The following charac- 
terization is proven in [291 Theorem 3.2(ii)-(iii)]. 

Proposition 3.5. A series W E V is a character of Q if and only if Ax){Wn) = Y17=o ® 
Wn-i for all n (i.e., W is group-like for Ad). 

We now derive a useful formula for left multiplication in I) by X*. 

Proposition 3.6. For $ G End(Q) and a G Comp(n), 

(3.5) X* ■ X, = (X,)*. 

Proof. Let a = ai . . . G Comp(?7,). By applying Proposition 13.51 and then Proposition 12. 2[ 
we obtain 

X* ■ X, = X* ■ (X,, ^ ■ ■ ■ ^X,J = (X* ■ X,J ^ ■ ■ ■ ^ (X* ■ X,J. 

Since Xq- is the identity permutation in ©a-, we have X* ■ Xq- = (X*)a.. For j3 G Comp(?7,), 

((X*),, ^ ■ ■ ■ ^ (X*),, I M^> = ((X*)„, ® ■ ■ ■ ® (X*)„, I A^M^)) . 

The right-hand side vanishes if /5 ^ a. If > a, then there exist compositions Pi, . . . ,Pk 
such that P = Pi ■ ■ ■ Pk and = \Pi\, and we have 

{{X^U ® • ■ ■ ® (X^, I A^M,)) = (X* I M,,> ■ ■ ■ (X* I M^,> . 
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According to (13.41) . this is tlie coefficient of in the monomial basis expansion of $(M^). 
This coefficient is given by {Xa \ ^{Mp)), or equivalently ((X^)* | Mpj. 

We have proved that X* ■ X^ and (X^)* agree on the monomial basis, and hence that 
they are equal □ 

Proposition 3.7. //$ G End(Q) then the character X'^ satisfies 

(3.6) {X^^ -W \G) = {W \ $(G)) 

for allW eV and G E Q. 

Proof. By Proposition 13.61 (13. 6p holds for W = Xa for all a, hence it holds in general by 
linearity. □ 

Remark 3.8. It is shown in [301 Lemma 5.1] that if G P is group-like for Ax> then 
the operator on V given hj V ^ W ■ V is a Hopf algebra endomorphism of (P,T»r, Ax)). 
This assertion and its converse are direct consequences of Proposition 13.71 (together with 
Proposition 13.51) . 

The preceding result says that X*, as an operator on V acting by left multiplication, 
is dual to $. Notice that (X* | F„) = (X* ■ r„ | F„) = (F„ | $(F«)) = c„,„, so that the 
homogeneous component of X* of degree n is 

(3.7) (^*)n. = ^ Ca,nYa = Y CD(a),n 

a6Comp(n) cr&&n 

Example 3.9. For the 6-map, we have 

(X®)„ = 2-(F„ + F(i,„_i)+F(i2,„_2) + --- + rin) = 2- ^' 

o-e6„:A(o-)=0 

where A (a) stands for the peak set of a. The fact that is dual to X® was noticed in [H 
Remarks 7.11] and [6]. 



Proceeding with the proof of Theorem 13. H we have 

Ca^^Yg = X* ■ Yg = Y CD(a),n ' CFT = ^ Cb(^^-1)^„ ■ VT, 

/3eComp{n) o-,Tee„:D(r)=/3 7r,Tee„;D(T)=/3 

which leads to the identity 

(3.8) Ca,f} = ^ CD{TTT-^),n- 

Te&„:D{T)=l3 

where vr is any permutation such that D^ir) = a In particular, Ca,f3 > for all G 
Comp(n). One consequence of is E/3eComp(n) = ErGe„ CD{nT-^),n = Eae6„ CD{a),n, 
which means every row of the matrix c has the same (positive) sum. 
Let us show that the sum of the row indexed by 1" is A". We have 

$(Mln) = $(Fln) = Y = ^ Cln^^^M^. 

agComp{n) aGComp{n) 



10 



PATRICIA HERSH AND SAMUEL K. HSIAO 



The coefficient of Min in the last expression is ^a,gComp(n) On the other hand, by (13.4p 
this coefficient is (X* | Mi)" = A". 

An interesting consequence is the identity 

(3.9) J2 = 

(Te6„ 

which in turn implies A" > and 

(3.10) Prob<i,(7r) =Z(L)(7r),n). 

To complete the proof of Theorem 13.11 it remains to show that K lumps K by descents. 
This requires checking that for any f] G Comp(n), 

(3.11) ^ CD{TT<7-^),n = ^ CD{Ta-^),n 

for all vr, r G (5„ such that -D(vr) = D{t), and 

f7ee„:D{(7)=/3 

Both of these identities follow directly from (13.81) . completing the proof. 
3.1. Stationary distribution. 

Theorem 3.10. Suppose that the hypotheses of Theorem \3.1\ are satisfied and that Ca,n > 
for some a G Comp(?T,) \ {n, 1"}. Then K has a unique stationary distribution given by the 
uniform distribution on permutations, and K has a unique stationary distribution equal to 
the distribution of descent sets in (5„. 

Proof. The proof has two parts, namely show (1) that for w G M[©„,] in which each per- 
mutation has nonnegative coefficient between and 1 so that these coefficients add up to 
1, the Markov chain resulting from left action by w has a one dimensional space of fixed 
vectors spanned by the vector in which all coordinates are equal, provided that the set of 
permutations appearing with nonzero coefficient in w generate (3„, and (2) that any single 
descent class other than those containing only the identity or only the longest element in 
will meet this condition of generating (5„. Our added assumption about Ca^n implies that 
there exists some r G (5„,, which is neither identity nor the longest permutation, such that 
Prob$(r) > 0. Since is the matrix for the left action of X]o-ee„ Pi'ob$(cr)cr on ©„, it 
follows from (1) and (2) that , and hence K, has unique stationary distribution equal to 
the uniform distribution on permutations. Our assertion about K follows from elementary 
properties of lumping. 

First we prove (1). Each permutation a appearing with nonzero coefficient in w gives 
a left action on (5„, so for each such a we make a directed graph with n\ vertices, using 
directed edges to indicate for each element of (5„ where it is sent by a. Now combine these 
graphs for the various a with nonzero a^-, i.e. using one vertex set of size n\ and the union 
of all directed edges for all such a. Choosing a set of a that generate implies that this 
directed graph has a directed path from each of its n\ vertices to all its other vertices. For 
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u any eigenvector with eigenvalue 1, we have wu = u, which translates to an equation for 
each of the n\ coordinates in u. These equations are indexed by permutations, so consider 
the equation indexed by some 7 G ©„. For u = J2ae6n ^o"*^' ^^^^ equation may be written as 

namely a sum in which the nonzero terms exactly come from permutations at the tails of 
arrows with head at 7. This expresses b.y as a convex combination (i.e. a weighted average) 
of these coefficients 60.-1(7); implying is neither the smallest nor largest value among these 
coefficients unless all are equal. However, chasing the directed graph around, we see that 
every permutation is expressed as a convex combination of others in such a way that no 
coefficient b^ may be smallest or largest among these coefficients, hence all must be equal, 
so we are done. If the permutations do not generate ©„, then the graph will have multiple 
components (resulting from multiple orbits in the left action on S„) , and we get a basis for 
the eigenspace with eigenvalue 1 by taking as basis vectors the sums over permutations in 
any one orbit. 

Now to (2). Consider a permutation a in our chosen descent class D. By assumption, 
there must be some values j,j + 1 not appearing consecutively in the one-line notation 
expression for a, this imphes (j, j + l)a G D, implying + 1) is in the subgroup Gd of 
&n generated by the elements of D. Thus, we get all adjacent transpositions except those 
+ 1) for i,i + 1 in consecutive positions in a, but then consider a maximal segment 
of consecutive values appearing consecutively in a. This segment must either be strictly 
increasing or strictly decreasing, and without loss of generality assume the former. Thus, 
the segment takes the form i,i + 1, . . . ,i + r, and by assumption we either have i 7^ 1 or 
have i + r n. Thus, we may swap either the values z — 1, z or the values z + r, z + r + lto 
obtain another permutation tt' in our descent class which has strictly shorter segment and 
which may be used to show either that the adjacent transposition + 1) is in Gd or else 
that {i + r,i + r + 1) G Go- Continuing in this manner, one may show that all adjacent 
transpositions are in Gd, implying Gd = ©n, as desired. □ 



3.2. Lumping by peak sets and other statistics. We establish variants of Theorem 13.11 
and Theorem 13.101 from which the probabilistic interpretation of the 0-map given in [8] can 
be deduced. 

Let $ G End(Q) and > 0. Let us say that has the partitioning property if the 
following two conditions hold. First is that there exists an equivalence relation on Comp(?7,) 
such that $(i^a) = ^{Fji) whenever a = /?, where a denotes the equivalence class containing 
a. Let E denote the set of equivalence classes and let 0s = $(Fa) for all a E E. The second 
condition is that {4>a}aeE is a basis for 0(Q„). If has full rank then it trivially has the 
partitioning property. A nontrivial example is the G-map: the equivalence class containing 
a G Comp(?T,) is given by a = {/? G Comp(n) | A(/9) = A(a)}. An open question is whether 
there are any other nontrivial endomorphisms with the partitioning property. 
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Suppose that $„ has the partitioning property. Then define ^ G Q hy 
and if A" 7^ as well then define 

Kia, 3) = —d^ n. 
A" 

For /5 e ^ define e by 

It follows from the duality between $ and X* (Proposition 13.71) that 
(3.12) ^*->>=E^s#" 

A direct consequence is the following: 

Proposition 3.11. has the partitioning property then the subspace ofDn spanned by 

{Ys}a(^E is the right ideal X* ■ P„. 

Specializing to the 0-map, X® ■ is just Nyman's peak algebra [2S], which was shown 
to be a right ideal in [501 [I] and implicitly in [21] . 

Further implications of fl3.12p are the following variants of Theorems 13.11 and 13.101 

Theorem 3.12. Suppose that has the partitioning property and the numbers Ca,n,<y G 
Comp(n) are nonnegative and not identically zero. Then K is a stochastic matrix and it 
lumps K by equivalence classes. 

Theorem 3.13. K has a unique stationary distribution if and only if there is some a E 
Comp(n) \ {n, 1"} such that Ca,n 7^ 0. In this case the stationary distribution is the lumped 
version of the uniform distribution on permutations. 

These results can be interpreted for the 6-map as follows, elucidating the results of [H 
§3.1]. The map ^0|n„ is dual to the left action of Xlaeen Probe(cr)o- = ZlaGe„;A(a)=0 ^ 
on the right ideal X® ■ Thus 2^6|n„ gives rise to a random walk on peak sets in which 
the peak set of a permutation vr steps to the peak set of cr~^7r with probability Probe (o"). 
The (unique) stationary distribution is the distribution of peak sets of random permutations. 

4. Spectral decomposition 

This section describes the eigenvalues and gives a recursive process for constructing a basis 
of eigenvectors for all the nonzero eigenspaces. See Macdonald's book [261 Ch. VI Section 4] 
for an earlier instance of this type of recursive eigenvector construction arising in a different 
context. We show that our eigenvectors are primitive elements. 
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4.1. Eigenvalues and eigenvectors. Given $ G End(Q), let 

A„ = I Mn) and Aq = ■ ■ ■ Aa^, 

for every > and every composition a = (ai, . . . , a^). By (13. 4p . Aq is the coefficient of 
in the monomial expansion of $(Mc) and in particular Ai = A. 

Since $ is triangular relative to the monomial basis (Remark 13. 4p . we obtain the following 
description of its eigenvalues. 

Proposition 4.1. For any $ G End(Q) and n > 0, the eigenvalues of taking into 
account multiplicities, are (AQ)Q,gComp(n)- 

Conversely, by Theorem 15.11 some of the eigenvalues can be arbitrarily prescribed: 

Proposition 4.2. For any list of real numbers Ui,U2,U3, . . ., there exists $ G End(Q) such 
that Aj = Ui for all i. 

The main theorem of this section is as follows: 

Theorem 4.3. Let $ G End(Q) and n > 0. Suppose that for every m < n such that Am ^ 0, 
we have 

(4.1) A,„ 7^ A/3 for all (3 G Comp(m) \ {(m)}. 

Suppose also that rank($„) = G Comp(n) | Aq, 7^ 0}. Then $„, is diagonalizable, and 
by duality so is the operator (X*)„. 

Example 4.4. For the 6-map we have A^ = if m is even and A/3 = 2^^^'> 7^ 2 = Am whenever 
m is odd and /5 G Comp(m) \ {(m)}. The dimension of 6(Q„) equals the Fibonacci number 
fn (with /o = /i = /2 = 1) [35], or the number of compositions of n with only odd parts. 
Thus On is diagonalizable for all n. 

Remark 4.5. The Hopf subalgebra 11 = G(Q) of Q is Stembridge's peak algebra, and the 
diagonalizability of the restriction of 6 to n„ was proved in [S] by a direct argument. 

More generally, a technique for diagonalizing operators on V that correspond to various 
transformations of alphabets for noncommutative symmetric functions is described in [2^ 
§3 & Note 5.20]. A prominent example is the A 1— > (1 — q)A transform, which yields the 
operator W ^ X® ■ W when q = —1 (cf. [6l Section 3]). The eigenvectors are constructed 
from a unique family of Lie idempotents. Here we describe a way to recursively construct 
eigenvectors (for a broader family of operators) that turn out to be Lie quasi-idempotents 
and satisfy a uniqueness property. 

Our construction of eigenvectors is as follows. For each m such that Am 7^ and (14.11) 
holds, define Zm G recursively by {Zm \ Mm) = 1 and 

(4.2) (Zm I Mp) = ^ V {Zm I M„) (X* ■ X„ I M^) if/3e Comp(m) \ {(m)}. 
For a = ai . . . ttfc G Comp(n) such that Z^^, . . . , Za^ are all defined, define Z^ G P„ by 

Note that if Z^ is defined then Aq 7^ 0. 
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Proposition 4.6. // is defined then 

(4.3) X*-Z, = A„Z,. 

Proof. Since X* is dual to $, it is an algebra map with respect to -k and so X* ■ ^ai...afc = 
(X* • Za^ (X* ■ ) . Therefore it suffices to prove that X* ■ Z„ = A„ Z„ , or equivalently 

that ^X* ■ Zn I Afg) = A„ (Z„ | M^) for all /3 G Comp(n). This is done as follows: 

(X* ■ Zn I Mp) = /x* ■ ^ (Z„ I M,)X„ I 

\ a£Comp(n) 

= 5^ (ZJ M„) (X* ■ X„ I M^) 

= Xf, {Zn \M(,)+J2 I ■ I ^/5> 

Q</3 

= {Zn I M^) + (A„ - A^) {Zn I M^) 
= A„ (Z„ I M^) . 

In the second equality, the sum is over a < /5 because the operator X* is triangular in the 
X-basis (see Remark 13.41) . □ 

To finish the proof of Theorem 14.31 note that because of our assumption about rank($„), 
it suffices to exhibit a set of linearly independent eigenvectors with cardinality equalling the 
number of nonzero eigenvalues counted with multiplicities. If (14. ip holds for every m < n 
such that Am 7^ 0, then Z^ is defined whenever A^ 7^ 0. Moreover, the Z^s are linearly 
independent because of their triangular relation to the X-basis. This completes the proof. 

Remark 4.7. The recursion ( 14. 2p was designed to make the calculation in the previous proof 
go through. However, it is easy to see that (14.21) is also a necessary condition for Zn to be 
an eigenvector with eigenvalue A„. The following makes this precise. 

Proposition 4.8. Let $ G End(Q) and m > 0. Suppose that A^ 7^ and (14. ip holds, 
and that Z'^ is any element ofVm satisfying X* ■ Z'^ = XmZ'^ and {Z'^ \ Mm) 7^ 0. Then 

Zni ■ 

Example 4.9. Assuming Zi, Z2, and Z3 are defined, we have 

^1 = Z2 = X2 — 2^11' 

V _ ^ , "12 ^ , U1U2 - U3 - U12 ^ 1 

^3 — -^3 H ^12 H -^21 + 77-^111- 

Us — U1U2 U'i — U1U2 3 

4.2. Primitive elements. An element W G Vn is called a primitive element if Ax){W) = 
1 ® W + W ^ 1. Ifiyis primitive then it is a Lie quasi-idempotent in the sense of [211 
Theorem 3.1] (cf. [291 Theorems 3.1 and 3.2]). 

Proposition 4.10. Let $ G End(Q) and n > 0, and suppose that Zm is defined for all 
m < n. Then Zn is a primitive element. 
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Proof. Let (2'*)agComp(n) ^ Q denote the dual basis of (^a)„ecomp{n), so that (Z^ | Z*^) = 
6a, i3- Then (Z*) form a basis of eigenvectors for $„. For any pair of compositions a,P such 
that |a| + \j3\ = n, we have 

(A^(z„)iz:®z;> = (z„|z:z*> 

by the Hopf algebraic duality between V and Q. Notice that Z*Z^ is an eigenvector of $ 
with eigenvalue AqA/j = Xa./s- This eigenvalue equals A„ if and only if a = (n) or /3 = (n). 
Therefore the expansion of Z^Z^ in the basis (Z*) involves the element Z* if and only if a 
or f3 is (n). □ 

In f2M Theorem 3.16] it is shown how to obtain a family of orthogonal idempotents of 
the descent algebra from a sequence of Lie quasi-idempotents. In particular, such a family 
can be obtained from our sequence (Z„)„>o. See (THl p. 919 Remark] for a related result on 
obtaining orthogonal idempotents of the descent algebra. 



5. Describing endomorphisms by explicit matrices 

We will describe how endomorphisms of Q can be represented by triangular matrices with 
polynomial entries. An algorithm is suggested for computing these polynomials. 

5.1. Matrices representing endomorphisms. A composition is called Lyndon if it is 
lexicographically smaller than all of its nontrivial cyclic rearrangements. Let C denote the 
set of Lyndon compositions. The set {Mq, | a G £} freely generates Q as an algebra, that 
is, Q = Q[M„ I a e £] [23 §6, Example 1] (cf. [23 Corollary 2.2]). For example, the 
composition 21 is not Lyndon, but we can express M21 uniquely as a polynomial in the 
monomial functions indexed by Lyndon compositions: 

M21 = M1M2 - M12 - M3. 

We call this the Lyndon expansion of M12. 

Recall from fl3.4p that the entries of the matrix for $ relative to the monomial basis are 
polynomials in the values (X* | M^). Since (X* | ■) : Q — > Q is an algebra map, (X* | M^) 
is a polynomial in the values (X* | Mpj for /3 G £. To describe these polynomials, we 
introduce commutative variables Ua.a G C and define /l„(/3,n), where (3 G Comp(n), to be 
the polynomial obtained by substituting Ua for in the Lyndon expansion of Mp. For 
instance, A(21, 3) = U1U2 — M12 — Ms- 

For n > 1 and a, /? G Comp(n), let v4„,(/5, a) = if a ^ /3 and 

An{(3,a) = Aa^{pi,ai)Aa2{p2,a2) ■ ■ ■ v4a^(/5fc, Cfc) 

if a < /9, where Pi, . . . , Pk are the compositions such that P = Pi ■ ■ ■ Pk and a = {\Pi\, \p2\, ■ ■ ■ AP 
In addition, we set Aq = (1). The matrices Ai,A2, and A^ are 



Ai 





1 


1 


Ul 





2 


11 


A2= 2 


U2 





11 
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3 




12 


21 


111 


3 















12 


Ul2 




UIU2 








21 


U1U2 - U12 - 


M3 





U1U2 





111 


\ul - \U1U2 + 


1^3 


\{u\ - U2)Ui 


\{ul - U2)Ui 


u\ 



The preceding discussion leads to this refinement of Proposition 13. 3t 

Theorem 5.1. For any assignment of real numbers to the variables Ua, the linear operator 
^ on Q defined by 

(5.2) $(M^) = Ani(3, a)M^ for all n > and (3 G Comp(n) 

a</3 

is a endomorphism of Q. Moreover, every endomorphism of Q has the form (15.21) . 

Example 5.2. We apply Theorem 15.11 to construct an endomorphism that satisfies the 
nonnegativity hypotheses of Theorem 13.11 and hence gives rise to a (5>S'*-distribution. 
Let be as in (13.11) . By a change of basis, 

I3>a 

For n = 3, this gives 

C3,3 = + \U1U2 + 1^3 Ci2,3 = \u\ - \u1U2 + M12 + 1% 

C21,3 = |m? + \U1U2 - U12 - |m3 Ciii,3 = ^uf - \u1U2 + \u^ 

Let us choose a specialization of the variables so that the Ca^z are nonnegative and not 
identically zero. For instance, set Ui = 2,^2 = 1/2,^3 = 2,mi2 = —1, and assign arbitrary 
values to all other Ua- Then 03,3 = 5/2, Ci2,3 = 1/2, 021,3 = 3/2, ciii,3 = 3/2, and the 
corresponding (55'*-distribution is (using (I3.10p ) 

V Prob$(a)a = 4- Y] c„,3 = 4 " 1^3 + ^ " (213 + 312) + -| " (132 + 231 + 321). 
^-^ Z-^ ^-^ lb lo lb 

o-eSs aGComp(3) 

We can quickly find the eigenvalues for the transition probability matrix K of the lumped 
random walk by reading off the diagonal entries of An and multiplying by 1/2'^; they are 
1,1/4,1/8,1/8. 

5.2. Algorithm for computing One might hope for a reasonable algorithm for com- 
puting the polynomials appearing in the matrix An-, which amounts to computing the poly- 
nomial expansion of an arbitrary Ma in terms of those Mg with (3 & C However, the Lyndon 
expansion for Ma is often exponential in length, precluding the existence of an efficient al- 
gorithm. 

An inefficient recursive algorithm is as follows: for a = (ai,...,a;) choose the earliest 
k such that (a^, a^+i, . . . , a;_i, a;) is Lyndon. Then M(^ai,...,ak-i)Miak,...,ai) is a sum over all 
ways of quasi-shuffling (oi, . . . , afc_i) with {ak, ■ ■ ■ ,ai), in the sense of [22]. This gives a 
straightening law on monomial quasisymmetric functions which may be used to reduce any 
monomial quasisymmetric function into a sum of products of Lyndon ones in a finite number 
of steps; one summand in M(^ai,...,ak^i)M(ak,...,ai) is Ma while all other summands either have 
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strictly fewer parts than a or else are lexicographically smaller of the same length as a\ in 
either case, they are closer to Lyndon. 

6. Connections to the QS-distribution and random walks of Bidigare, 

Hanlon, and Rockmore 

Throughout this section, let (ri,r2, . . .) be an infinite sequence of nonnegative real num- 
bers summing to 1. The QS- distribution on (5„ may be defined [SU Theorem 2.1] as the 
probability distribution on in which a permutation vr is selected with probability 

ProbQ5(7r) = Fc,(^-i)(ri,r2, . . .). 

The link between the QS'-distribution and the (55'*-distribution comes from the obser- 
vation that the evaluation map on Q, sending Xi to for all z is a character, and so by 
Proposition 13.71 there is a unique $ G End(Q) such that 

(6.1) (X* I G(xi,a;2,...)> = G'(ri,r2,...) for all G G Q. 
This leads to the following result: 

Theorem 6.1. There exists $ G End(Q) such that for every permutation n, 

(6.2) Prob$(7r) = ProbQ5(7r"') 

In other words, the transition probability matrix of the left random walk on driven by the 
QS-distribution is , with A'*(7r, avr) = PiohQsicr) for all a,7i E (5„. 

Proof Choose $ so that ([6ll]) holds. By ([32D and fISTTOD . 

i^Dw(ri,r2, . . .) = (X* I Fz^w) = A" Prob„(7r). 

We have A = (X* | Mi) = Mi(ri, ^2, . . .) = ^ = 1, completing the proof. □ 

Remark 6.2. The QS'-distribution is an instance of a transformation of alphabets in the 
context of noncommutative symmetric functions [21]. This viewpoint is developed in further 
in [13 Section 3.6], where the main results of [M] are deduced from the theory of free 
quasisymmetric functions. 

Let us describe more explicitly the entries of K and K. Let 61,62, ... be i.i.d. random 
variables such that 

Prob(5i = j — 1) = Tj for j a positive integer. 

Given a sequence of distinct numbers tt = (tti, . . . , Hn), let st(7r) denote the standardization 
of TT, that is, the unique permutation (ai, . . . , (T„) G &n such that for all i,j < n, Hi < Hj if 
and only if cr^ < (Xj. For instance, st((— 2, 1, 3, —4)) = (2, 3, 4, 1). 

Theorem 6.3. Let $ be as in Theorem \6.1\ For all a,T E ©„ and (3 G Comp(n), we have 
K^{a, t) = Prob(st((a-i + 6in, a2 + 6271, . . . , cr„ + (5„n)) = r) 

and 

Kl{D{a),l3) = Prob(D(((7i + 6in, ^2 + 62n, . . . , a„ + (5„n)) = /3). 
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Proof. Let n = ar ^. By Theorem 16. 



■n 



In other words, K{a, r) is the probabihty that 

(6.3) Si < 62 < ■ ■ ■ < Sn and 6i < Si+i whenever i G 

Now consider instead the probabihty that st(((7i + 6in, 02 + ^2"^-, • • • , o'n + ^n'^)) = t = ix^^o. 
Let ii, . . . ,in be indices such that = ttj for all j. Multiplying a on the left by tt"^ has 
the effect of replacing the occurrence of ai. in (ai, . . . , cr^) by the value j. The resulting 
permutation equals st((cri + 6in, 02 + ^2"^-, • • • , o'n + ^n'^)) if and only if tti + bi-ji < + (Jjjn < 
■ ■ ■ < 7r„ + 5j^n, and this occurs if and only if 

(6.4) 5n < < ■ ■ ■ < and 5^^. < whenever j G S'D(7r)- 

Since the (5i's are i.i.d., events (16.31) and (16. 4p occur with equal probability. The formula for 
K follows via lumping. □ 

The eigenvalues of K can be determined immediately from Proposition 14.11 (cf. [3ll The- 
orem 2.2] and references thereafter). 

Proposition 6.4. Let $ he as in Theorem \6.1[ For any n > 0, the eigenvalues of K are the 
power sum symmetric functions p^{ri,r2-, ■ ■ ■) where fi ranges over all partitions of n. The 
multiplicity ofp^{ri, r2, . . .) is the number of different compositions obtainable by rearranging 
the parts of the partition fi. 

Bidigare, Hanlon, and Rockmore (BHR) introduced a class of random walks on chambers 
of central hyperplane arrangements [5], generalizing many shuffling and sorting schemes 
like the Tsetlin Library. Their work was developed further by Brown and Diaconis ^ and 
Brown [101 IH]. In some cases a BHR random walk is isomorphic to a right random walk 
on a finite reflection group. For instance Stanley showed that the transpose of the right 
random walk on driven by the QS'-distribution is an instance of a BHR random walk 
on the chambers of the braid arrangement [M]. More generally, Theorem 8 of [10] implies 
that ii W = J2cree W{a)a is a probability distribution on ©„ such that W G Vn and the 
expansion of W in the basis {Xa} has nonnegative coefflcients, then right multiplication 
by W is isomorphic to a BHR random walk. Such a distribution W will be called a BHR- 
distribution. 

Not every (5>S'*-distribution is a BHR-distribution. The G-map provides one family exam- 
ples: for instance when n = 3, 

{X% = 2^-Y^ Probe(fT)fT = 2(1^3 + Yi2 + Yni) = 2{Xs - X21 + Xni). 
0-663 

The endomorphism $ considered in Example 15.21 provides another example: 



{X% = 2' 



—Fa + — F12 + — (F21 + >^iii) 
16 16 16^ ' 



3 

2X3 — X12 + -Xiii. 
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Note that BHR random walks on (5„ are right random walks, whereas in this paper we are 
dealing with left random walks (encoded by K) and their lumped versions (encoded by K). 
This distinction might not matter much in practice, since there is no difference between left 
and right random walks if we start at the identity permutation. Also, all of the associated 
matrices-left or right, lumped or not-that arise from a BHR-distribution on &n have the 
same eigenvalues, thanks to fiUi Theorem 8] (cf. [211 Theorem 3.12]). 

The references [5l [12], [10] all give bounds on rates of convergence to the stationary distri- 
bution. Here we will not pursue the problem of estimating the convergence rates of K or K, 
although it would be interesting to see whether any techniques from those papers could be 
adapted to our setting. 

7. Connections to o-shuffles and the Tchebyshev operator 

7.1. a-shufHes. Let a be a positive integer. An a-shuffte of a deck of cards involves cutting 
the deck into a (possibly empty) packets according to the multinomial distribution and then 
letting cards fall one at a time from the bottoms of the packets into new pile, where the 
probability that the bottom card from a particular packet falls is proportional to the current 
size of the packet. When a = 2 this is just the standard Gilbert-Shannon-Reeds (GSR) 
model of riffle shuffling. See |lj details. 

A well-known formula due to Bayer and Diaconis ^ for the probability that the deck is 
in arrangement vr after an a-shuffle is 

/^,-,^ T^i/x fn + a - di-K'^) - 1\ , „ 

(7.1) Proba(7r)= /a". 



n 

where d{'K) is the number of descents in tt. 

Let '^a denote the unique endomorphism of Q such that = X -k ■ ■ ■ -k X (a terms), 
where X is the universal character introduced in Section [31 This convolution character is 
discussed in [21 Example 4.7], where an explicit formula for is given. 

Proposition 7.1. For every permutations n, 

(7.2) Prob^,(7r) = Prob,(7r-i) = FiohQsiir''), 

where the QS -distribution has ri = r2 = ■ ■ ■ = Va = \ and = for i > a. 

Proof. The second equality was shown by Stanley [M]. Using (13.41) it is easy to obtain a 
formula for ^'q in the monomial basis (or see [21 (4.5)]), from which it follows that 

— ^ fn + a-£{/3)\ 



This is equivalent to the formula of Bayer and Diaconis, as £(-D(7r)) = d^n) + 1. □ 
Proposition 17. II can also be inferred from [TJl §3.6]. 

The eigenvalues and diagonalizability of operators associated with a-shuffles are well 
known; see, for instance, [H \5\ [TU]. Noting that | M„) = a, the results of Section [H 

imply the following: 

Proposition 7.2. For alln > 0, (\l/a)n is diagonalizable. Its eigenvalues, with multiplicities, 
are (a'^^"^)aeComp(n)- 
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It is also possible to determine an explicit formula for the eigenvectors: 

Proposition 7.3. For every n > 0, the unique eigenvector Zn such that X"^" ■ Z„ = aZn 
and {Zn I Mn) = I is given by 

(7.3) Zn= Hw^'"'- 

/3GComp(n) 



Proof. For compositions a < as above, let 



a \ la 

,m))"\m) 

where /3 = /3i ■ ■ ■ /^^ and a = . . . , \(3k\). It follows from ([S3D that (X'^" ■ Xp \ M^) 
g{P,a). If (E3]) holds then 

/36Comp(n) ^'^'^ 7>/3 7eComp(n) \/3<7 ^ ' 

So, to conclude that ■ Z„ = aZ„ it suffices to prove 

We may assume without loss of generality that 7 = In this case f l7.4p becomes 



a ■ 



(ci,...,Ch)f=n 

which is verified by equating the coefficients of x" in 

ln(l + ((1 - 1)) = aln(l + x). 



□ 



Remark 7.4. Under the isomorphism between (D,*, Ax>) and the Hopf algebra of noncom- 
mutative symmetric functions, n ■ Z^ goes to the noncommutative power sum symmetric 
function of the second kind indexed by n (see [I9] for definitions). 

Let {Pa} C Q„ be the dual basis of {Za}. Thus, (Zq, | Pp) = 6a,i3 and 

*a(P/3) = a'^^^Pp. 

This basis was introduced in [27]. An explicit formula for P^ is obtained as follows. For 
compositions a = (oi, . . . , a^) and P = (61, . . . , 6^) such that a < P, let Pi, P2, ■ ■ ■ , Pk be 
the sequence of compositions such that P = Pi - ■ ■ Pk and \Pi\ = ai for all i. Let f{P,a) = 
1)! ■ ■■iiPkV.. Then we have 



(7.5) P, = 53^M„. 

This is [271 Formula (2.12)]. 



RANDOM WALKS ON QUASISYMMETRIC FUNCTIONS 



21 



7.2. Tchebyshev operator of the second kind. The Tchebyshev operator (of the second 
kind) was introduced by Hetyei [2T] as an operator on afe-words that encodes how the flag 
/-vector of a graded poset changes when the poset undergoes a certain combinatorial trans- 
formation. The Tchebyshev polynomials of the second kind can be obtained by a suitable 
specialization of the operator. Ehrenborg and Readdy [18] introduced an equivalent operator 
U on Q and showed that it is a Hopf endomorphism. They showed that U is diagonalizable 
and determined the eigenvalues and eigenvectors. Here we explain how the spectra can be 
deduced from our results and how U encodes riffle shuffles. 

Given a graded poset P of rank n > with unique minimal and maximal elements and 
1, respectively, define F{P) G Q„ by F{P) = 1 if = and 

^(P) = X] ^{p(io,ti),p{ti,i2),.-,p(tfe-iA)) 

o=to<ti<-<tfc=i 

if n > 1, where the sum is over all chains in P from to 1. The definition of F{P) is due to 
Ehrenborg [16]. See [32] for background on posets. The Tchebyshev operator of the second 
kind [TK] is the linear operator U on Q satisfying 

U{F{P)) = J2 I F([to,ti])) ■■■{G I F{[t,.,,t,])) ■ M(p(to,to,...,p{t.-.t.)) 

6=to<ti<-<tfe=i 

for every graded poset P, where G G V is the character given by {G \ F(P)) = jj^P. 
Proposition 7.5. We have 

(7.6) U = *2. 

Proof. It is straightforward to check that G = X -k X , using the fact that P i— >■ F{P) defines 
a Hopf algebra homomorphism from the Hopf algebra of graded posets to Q [16] and that 
Q is spanned by the F{P) as P ranges over all graded posets [5]. Comparing (13.41) with the 
definition of U, we get ?7 o F = \l/2 o F, which implies U = since the F{P) span Q. □ 

Formulas for the eigenvalues and eigenvectors are given in Proposition 17.21 and 07.51) (cf. 
[T8| Theorem 10.10]). Also, Proposition 17.11 yields the following probabilistic interpretation: 

Corollary 7.6. The coefficient of F^ in the fundamental-basis expansion of i^U^{Fn) is 
the probability of ending up with some permutation with descent composition a G Comp(?7,) 
after performing k riffle shuffles. 

A natural question is whether there is a transformation of graded posets for which the 
operator "^m, m > 2, plays the role analogous to the Tchebyshev operator U. 

8. A RANDOM WALK ON a6-WORDS 

The cd-index is a remarkably convenient encoding for the fiag /-vector of any Eulerian 
poset (e.g. Bruhat order), namely the vector counting chains through various rank sets (e.g. 
flags of faces of specified dimensions in a regular cell decomposition of a sphere). The ab- 
index is a vector which makes sense for all graded posets, and has as its basis all words in 
the two noncommuting variables a and b. The crf-index is derived from the afe-index by the 
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substitutions c = a + b and d = ah + ha. There is an extensive literature using cci-index to 
study which vectors may arise as flag /-vectors. See e.g. |7] for further background. 

In [TTj, Ehrenborg introduced a family of linear operators Ur which act on a6- words as 
follows. Given an a6-word, replace each appearance of ah by r{ah—{r — l)ha). Now send each 
remaining a from the original word to a-|- (r — 1)6 and send each remaining h from the original 
word to 6 + (r — l)a. This operator, which generalizes the uo map of [7], was designed to 
compute flag vectors of the r-Birkhoff transform, perhaps most notably including a family of 
complex regular polytopes known as Shephard's generalized orthotopes. Ehrenborg showed 
that the operator ruj^ is isomorphic to a Hopf algebra endomorphism G End(Q) and he 
made some conjectures about the spectrum. This section proves Ehrenborg's conjectures. 
We will then show that is dual to the g-bracketing operators studied in [21]. Finally, we 
give a probabilistic interpretation of that generalizes a theorem of Stembridge [55] . 

First let us define d^- Given an a6-word u = M1M2 where each Ui is a or h, we 

define Su C [n] by putting i E Su H and only if Ui = h. For instance Sabaab = {2,5}. 
The correspondence u ^ Su is a. bijection between a6-words of length n and subsets of 
[n]. This bijection induces an isomorphism, denoted 7, from the vector space of a6-words 
onto 0^]^ Qi, given by 7(u) = Fco(Su)- Define to be the linear operator on Q given by 
^9^(F) = 7(ro;^(7-i(F))) if F G Qi and ^9^(1) = 1. Ehrenborg [H] proved that is 

a Hopf algebra endomorphism of Q and that is Stembridge's map 0, and he made the 
follow conjecture on the spectrum: 

Proposition 8.1. For all n > and r G M, {^r)n is diagonalizable and its eigenvalues, 
counting multiplicities, are 

A„ = (1 - (1 - rr)il - (1 - rD ■ ■ ■ (1 - (1 - rT'^) 

for a = (ai, 02, ... , a^) G Comp(n). 

Proof. For any a6-word u, r"'K{co{Su),n) is the coefficient of a"~^ in r-ujr{u) (here K = 'K^,'^). 
This coefficient is straightforward to compute using the definition of Ur'. it is r(r — l)'^' if u 
has the form h^d'^~^~^ and otherwise. It follows that 



(8.1) K{a,n) 
Note that 



if a = (l^n-A;) for 0< A;<n-1, 
otherwise. 



\ aGComp(n) / 7GComp(n) aGComp(n) 

Since A„ is the coefficient of M„ in the monomial expansion of -^riMn), we have 

n-1 

A„= J2 (-l)^^°^"'r"Z(a,r2) = ^(-l)V(r-l)'= = 1- (1-r)". 

a€Comp(n) A;=0 

The formula for the eigenvalues now follows from Proposition 14.11 and the diagonalizability 
follows from Theorem 14.31 □ 
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Remark 8.2. If r > 1 and tt G ©„ then Prob^^(7r) is the probabihty that a deck of n cards 
is in arrangement vr after performing an inverse r- weighted face- up face-down shuffle; that 
is, remove a subset of cards from the deck to form a new packet, where a card is selected 
independently for removal with probability 1 — ^ and the cards are kept in the same relative 
order, and then place the new packet face down on top of the pile of remaining cards. 

In [21] it was show that the A (1 — q)A transform on noncommutative symmetric 
functions is equivalent to the left action on the descent algebra Vn by 

This action was shown to be diagonalizable and formulas for the eigenvalues and eigenvectors 
were given. The eigenvalues turn out to be the same as the eigenvalues for i^i-q. This is 
explained by the following result. 

Proposition 8.3. The restriction of 'Or to Qn is dual to the left action of rii-r on P„; that 
is, 

iVi-r-W \G) = {W \MG)) 
for all W G Vn and G G Q„. In other words, {X'^'~)n = ?7i-r- 

Proof. Using the formula for K{a,n) derived in the proof of Proposition 18.11 we have 

n-l 

k=0 aGComp(n) 

Applying Proposition 13.71 completes the proof. 

This result may also be proven by constructing an explicit isomorphism from 'dr to the 
dual of r/i-r. Consider an afe-word upon which Ehrenborg's operator acts. Send each "a" 
to a descent and send each "6" to an ascent. Send r to 1 — g. Each "a6" now corresponds 
to a valley, and for each set 5", the allowable sets T in the image are as follows. Each 
valley must be sent either to a valley or to a peak for a set to be allowable, but this is the 
only requirement. Now for each T, the coefficient r"*(r — 1)" is obtained as follows. The 
exponent m counts valleys in S, just as the exponent for 1 — g in 77^ does. The exponent 
n counts discrepancies between S and T, with each valley/peak combination counted as a 
single discrepancy. Thus, we obtain the following formula, which is the dual version of the 
formula for the operator rjg proven in Proposition 5.41]: 

A{P)CScA{Sc+l) 

where /3 can be written as a concatenation f3 = (3i - ■ ■ (3hi(i3) of hook compositions /3i = {1^, I) 
SindbiS,T) = \{1 + {S\T))U{T\S)\. □ 

Given r > 1, let 5^,1, ^r,2, ... be i.i.d. random variables taking on values in {1, —1} such 
that 

Prob((5r,i = 1) = -, and Fioh{Sr,i = — 1) = 1 . 
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Theorem 8.4. For all a,T E &n and (3 G Comp(n), we have 

Kf;{(T, t) = Prob(st(((5r,i(Ti, . . . , Sr,n(Jn)) = t) 

and 

Kl^{D{a),(3) = Prob(i?((5,,iai, . . . , = /3). 

Proof. Left multiplying a by y(ifc,.„_fc) has the effect of negating all possible choices of k — 1 
values chosen from [2, n] within the permutation a, then standardizing values to obtain a 
permutation, since this negation reverses relative order of the values being negated and makes 
them smaller than all other values. Notice also that negating the value 1 has no impact on 
the relative order of values. The sum 

rt-l 

^(r - l)^F(i.,„_fc) 

fc=0 

may therefore be viewed as a sum over all choices of which values in [2, n] to negate, with k 
recording the number of values other than 1 being negated. If each value in [n] is indepen- 
dently negated with probability 1 — ^, then 

A:=0 

is a sum over all possible subsets of [n] to be negated, with each possibility multiplied by its 
probability of being chosen. □ 

Setting r = 2 in Theorem 18.41 yields Theorem 3.6 of Stembridge [35] . 
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